This repository was archived by the owner on Oct 16, 2024. It is now read-only.
DLFS - A filesystem built on replicated logs #43
Closed
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Contributor
gerritsundaram
commented
Nov 2, 2016
gerritsundaram
commented
- implement the hadoop FileSystem api
- implement the hadoop FileSystem api
sijie
reviewed
Nov 15, 2016
There was a problem hiding this comment.
The layout looks good to me. The initial code change looks good too. I think the major piece missing here is more about the metadata management or how to connect the stream namespace to filesystem namespace.
I like the discussion about stream storage primitives. I think you should drive the discussion there and finalize the stream storage primitives in DL. After that, it might be easier for an FileSystem implementation here.
|
@gerritsundaram any updates? |
jiazhai
reviewed
Oct 24, 2017
| long blockSize, | ||
| Progressable progressable) throws IOException { | ||
|
|
||
| // TODO: support overwrite, support permission |
There was a problem hiding this comment.
Shall we open a github issue for this?
jiazhai
reviewed
Oct 24, 2017
|
|
||
| @Override | ||
| public void write(byte[] b, int off, int len) throws IOException { | ||
| // TODO: improve AppendOnlyStreamWriter |
There was a problem hiding this comment.
Shall we open a github issue for this "todo"?
|
Close this since it is overtaken by #227. marked it as duplicated. |
jiazhai
pushed a commit
that referenced
this pull request
Oct 30, 2017
Descriptions of the changes in this PR: - FileSystem API wrapper built over dlog API (This is based on initial implementation from gerritsundaram at #43) Features supported: - create and append files - open files for reading - input stream and output stream for reading and writing data - list files - get file status - rename - mkdir Features aren't supported: - truncate - currently there is no clear distinguish between file and dir - only support delete recursive (This change includes small changes for #224 #225 #226 ). Author: Sijie Guo <sijie@apache.org> Reviewers: Jia Zhai <None> This closes #227 from sijie/fix_create_log
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.